Establishing a location for unmanned delivery/pickup of a parcel

ABSTRACT

Systems, media, and methods for collecting front-end information from a customer to establish a delivery/pickup location for delivery/pickup of a parcel by unmanned vehicles are provided. In some embodiments, a customer may be guided though a registration process that includes establishing release/retrieve zones for unmanned delivery/pickup. In some cases, release/retrieve zones may be determined using a map provided to the customer. Areas to establish release/retrieve zones may be suggested to the customer, or in some cases, the customer may suggest potential release/retrieve zones. It may be determined whether a release/retrieve zone is suitable based on customer configurations and consents. Some embodiments include establishing a release/retrieve zone using augmented reality. In some cases, customers may wish to designate off-limits areas, including no-fly zones, to prohibit certain unmanned vehicles from entering the off-limits areas.

BACKGROUND

Delivery of parcels between locations has evolved over years due to theemerging technologies brought about to solve problems such as increasingdemand for delivery, expanding delivery areas, reducing delivery timeand cost, generally increasing delivery efficiency, and the like. Forexample, delivery has evolved from delivering a parcel on foot; to usinga horse-and-buggy; to delivering a parcel using manned vehicles, such astrains, cars, tractor trailers, and planes.

To meet ever-increasing delivery demand, while continuing to increaseefficiency, some have begun to experiment with parcel delivery/pickupusing unmanned vehicles, for example, unmanned aerial vehicles (UAVs).Thus, the focus of delivery/pickup technology has been on the physicalstructure of an unmanned vehicle and enabling the unmanned vehicle tolift a parcel and maneuver about its surroundings. Technologies such aslive video feed, mapping systems, and winches have been developed oraltered to assist unmanned vehicles in guidance and delivery. Forinstance, a live video feed or mapping system may be used to locate aparticular area in which to drop a payload. Consequently, thesetechnologies require that an unmanned vehicle be at or near thedelivery/pickup location before determining how to complete adelivery/pickup or whether certain obstacles prevent delivery/pickupaltogether. However, to continue to meet demand and increase efficiencyfor delivering parcels, front-end information may be collected regardingthe delivery/pickup location.

SUMMARY

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used in isolation as an aid in determining the scope of the claimedsubject matter.

The present technology generally relates to establishing adelivery/pickup location for delivery/pickup of a parcel by an unmannedvehicle. In some aspects, a delivery/pickup location may be registeredby establishing a release/retrieve zone for an unmanned vehicle torelease/retrieve a parcel.

In some instances, a registration process may guide a customer throughthe steps for establishing a delivery/pickup location by presenting aset of options. In some cases, potential release/retrieve zones andlocation information, which may include images and/or other sensed data,may be received from the customer or derived from information receivedfrom the customer. In some cases, potential release/retrieve zones maybe suggested to the customer. Based on the potential release/retrievezones and/or the customer's selection of potential release/retrievezones that are provided, it may be determined that an area is suitablefor release/retrieve of a parcel by an unmanned vehicle. Arelease/retrieve zone may be established based on this determination.

Accordingly, aspects of the present technology present systems, methods,and media for collecting front-end location information to assist indelivery/pickup of parcels by unmanned vehicles. In one embodiment, asystem for establishing delivery/pickup by an unmanned vehicle ispresented. The system comprises a graphical user interface; and one ormore processors. The one or more processors are configured to present,via the graphical user interface, a set of configurable options for theunmanned vehicle to deliver/retrieve a parcel to/from a delivery/pickuplocation. In some cases, the set of configurable options comprises arequest for or an option to define a release/retrieve zone. The one ormore processors are also configured to receive one or more inputs basedon the set of configurable options, wherein at least one input comprisesa potential release/retrieve zone, and determine whether the potentialrelease/retrieve zone is suitable to be the release/retrieve zone forthe parcel by the unmanned vehicle based on the one or more inputsreceived. Based on a determination that the potential release/retrievezone is suitable, the processors are configured to establish thepotential release/retrieve zone as the release/retrieve zone for theunmanned vehicle to release/retrieve the parcel at the delivery/pickuplocation.

In another embodiment, a method for establishing delivery/pickup by anunmanned vehicle is presented. The method comprises presenting, via agraphical user interface, a request to establish a release/retrieve zonefor the unmanned vehicle to deliver a parcel at a delivery/pickuplocation, and receiving location information associated with thedelivery/pickup location. The method also comprises providing, based onthe received location information, one or more potentialrelease/retrieve zones for the delivery/pickup location, and receiving aselection of the one or more potential release/retrieve zones. Themethod also comprises establishing the selection as the release/retrievezone for the unmanned vehicle to deliver the parcel to thedelivery/pickup location.

In yet another embodiment, one or more computer-storage media havingcomputer-executable instructions that, when executed, perform a methodof registering a delivery/pickup location for unmanned delivery/pickup.The method comprises receiving a request to register the delivery/pickuplocation for unmanned delivery/pickup, and receiving locationinformation associated with the delivery/pickup location. Based on thelocation information, the method comprises determining availability ofunmanned delivery/pickup. And based on determining availability ofunmanned delivery/pickup, the method comprises registering thedelivery/pickup location for unmanned delivery/pickup of a parcel.

BRIEF DESCRIPTION OF THE DRAWINGS

The present technology is described in detail below with reference tothe attached drawing figures, wherein:

FIG. 1 is an exemplary operating environment for registering adelivery/pickup location and setting a release/retrieve zone inaccordance with an aspect herein;

FIG. 2 is a block diagram of an exemplary computing environment suitablefor use in implementing embodiments herein;

FIGS. 3A-3C are exemplary illustrations of a customer interacting with aGUI in accordance with an aspect herein;

FIG. 4 is an exemplary illustration of a registration process inaccordance with an aspect herein;

FIG. 5 is an illustration of an exemplary customer utilizing a userdevice for augmented reality in accordance with an aspect herein;

FIGS. 6A-6D are exemplary illustrations of a GUI displaying a potentialrelease/retrieve zone using augmented reality in accordance with anaspect herein;

FIGS. 7A-7D are exemplary illustrations of a UAV navigating a path inaccordance with an aspect herein;

FIG. 8 is a block diagram of an exemplary method for establishing adelivery/pickup location in accordance with an aspect herein;

FIG. 9 is a block diagram of an exemplary method for establishing arelease/retrieve zone for delivery/pickup by an unmanned vehicle inaccordance with an aspect herein; and

FIG. 10 is a block diagram of an exemplary method for registering adelivery/pickup location for unmanned delivery/pickup of a parcel.

DETAILED DESCRIPTION

The subject matter presented herein is described with specificity tomeet statutory requirements. However, the description itself is notintended to limit the scope of this disclosure. Rather, the inventorshave contemplated that the claimed or disclosed subject matter mightalso be embodied in other ways, to include different steps orcombinations of steps similar to the ones described in this document, inconjunction with other present or future technologies. Moreover,although the terms “step” and/or “block” might be used herein to connotedifferent elements of methods employed, the terms should not beinterpreted as implying any particular order among or between varioussteps herein disclosed unless and except when the order of individualsteps is explicitly stated.

Throughout the Detailed Description, the term “zone” is used in thecontext of a delivery/pickup location. As used herein the term “zone” isused broadly to refer to a single location on a surface or a definedarea on a surface that is suitable for accepting a parcel for deliveryfrom an unmanned vehicle and/or holding a parcel for pickup by anunmanned vehicle. In some instances, the surface may support a landingor traverse by the unmanned vehicle. For example, the zone may be a flatarea of land large enough for an unmanned UAV to land and take offsafely. In another example, a zone may be an area where a terrestrialunmanned vehicle would navigate to in order to deliver or retrieve aparcel. As such, it follows that the term “zone” may connote varioustwo-dimensional sizes, as there are various types and sizes of unmannedvehicles having various requirements for traversing or landing on anarea. Thus, for example, the term “zone” may be defined as a singlepoint having a radius, where the radius may be a different length fordifferent types of unmanned vehicles. The term “zone,” however, is notlimited to only spaces that are circular in nature, but instead, theymay be defined in the context of any shape or size depending on theapplicable unmanned vehicle that may utilize the zone. In some cases,the term “zone” may further be used to represent a three-dimensionalspace. For example, a release/retrieve zone for a UAV may have twodimensions, such as a length and width along an area on a surface, andit may have a third dimension in the form of a height that extendsupward from the surface that may represent a clear area of approach forthe UAV to release/retrieve the parcel from the surface.

As previously described, it may be beneficial to collect front-endinformation regarding a delivery/pickup location and potentialrelease/retrieve zones. This information may help determine what typesof unmanned vehicles are capable of making deliveries. Knowing whattypes of unmanned vehicles are capable of making a delivery/pickup to aparticular delivery/pickup location helps optimize route and logisticsplanning. In the same sense, knowing location information may alsoassist in facilitating a release/retrieve of a parcel at a particularlocation. One method of collecting front-end location information is tocollect the information from the customer before a delivery/pickup ismade. As such, a customer registration process that includes receivinginformation about the delivery/pickup location may aid in collecting thefront-end information needed to make logistical decisions fordelivery/pickup using unmanned vehicles.

In brief and at a high level, systems, methods, and media are providedfor registering a delivery/pickup location for delivery/pickup of aparcel by an unmanned vehicle. In some cases, a customer may interactwith the system through use of a mobile application or “app,” on a userdevice. The customer may walk through the registration process using agraphical user interface (GUI). In some instances, the registrationprocess may provide a set of configurable options to the user. Tofacilitate delivery/pickup to a delivery/pickup location, one or moredelivery/pickup zones may be determined during a registration process.In some cases, the delivery/pickup zones may be determined at any timeby selecting an available option provided by the application.

In one exemplary scenario, a map may be provided to the customer. Themap may comprise suggested areas that are suitable for unmanneddelivery/pickup of a parcel. In some cases, the customer may utilize themap to determine suitable areas. Using the map, the customer may provideinputs that are received by the system. For example, the customer mayset an off-limits area for unmanned vehicles, set a primaryrelease/retrieve zone, or set an alternative release/retrieve zone.

In another exemplary scenario, the customer may utilize augmentedreality provided by a GUI on a user device. Through augmented reality,the customer may provide a potential release/retrieve zone. The systemmay determine that the potential delivery/pickup zone is suitable fordelivery/pickup of a parcel by an unmanned vehicle. After providing anindication to the customer that the potential delivery/pickup zone issuitable, the system may receive an indication that the customer wishesto establish the area as a release/retrieve zone. Based on receivingthis indication, the system may establish the potential delivery/pickupzone as a release/retrieve zone for unmanned delivery/pickup.

Having described some examples at a high level, FIG. 1 is now providedto illustrate an example operating environment 100 for registering adelivery/pickup location for delivery/pickup of a parcel by an unmannedvehicle. In general, unmanned vehicles are those systems that arecapable of operating without an on-board human pilot. Unmanned vehiclesmay include terrestrial, aquatic, or aerial vehicles. In some instances,unmanned vehicles may have a human on board. The on-board human may becapable of taking control of the unmanned vehicle as desired or needed.In some cases, an unmanned vehicle may be controlled remotely by a humanpilot, for example, from a control center. Thus, to complete anobjective, unmanned vehicles may operate autonomously, under theguidance of a preprogrammed instruction, or under partial or totalcontrol of a remote human operator. In FIG. 1, UAV 150 represents oneexample of an autonomous system that may be used in environment 100.

Environment 100 may also include other components, such as user device120, datastore 125, computing system 130, stationary personal assistant135, mobile computing device 140, imaging system 145, UAV 150,terrestrial vehicle 160, satellite 170, and other similar systems. Thesecomponents may communicate through communications network 115 which mayinclude, without limitation, one or more local area networks (LANs)and/or wide area networks (WANs). In exemplary implementations,communications network 115 comprises the Internet and/or a cellularnetwork, amongst any of a variety of possible public and/or privatenetworks. In some embodiments, components may communicate directlythrough wired communication channels, or through short or long distancewireless communication methods. These are merely examples ofcommunication methods, and many others are generally known in the art,and are omitted for brevity; however, all such communication methods andchannels are contemplated to be within the scope of the technologypresented herein.

In one embodiment, the functions performed by components withinenvironment 100 are associated with one or more personal digitalassistant applications, services, or routines. In particular, suchapplications, services, or routines may operate on one or more userdevices (such as user device 120 and mobile computing device 140),servers (such as computing system 130), may be distributed across one ormore user devices and servers, or be implemented in the cloud. Moreover,in some embodiments, the components of environment 100 may bedistributed across a network (such as communications network 115),including one or more servers (such as computing system 130) and clientcomputing devices (such as user device 120 and mobile computing device140), in the cloud, or may reside on a user device, such as user device120 and mobile computing device 140. For example, app 180 may be locallystored on datastore 125, user device 120, mobile computing device 140,and the like, or may be distributed in the cloud. Moreover, thesecomponents, functions performed by these components, or services carriedout by these components may be implemented at appropriate abstractionlayer(s) such as the operating system layer, application layer, hardwarelayer, etc., of the computing system(s). Alternatively, or in addition,the functionality of these components and/or the embodiments describedherein can be performed, at least in part, by one or more hardware logiccomponents. For example, and without limitation, illustrative types ofhardware logic components that can be used include Field-programmableGate Arrays (FPGAs), Application-specific Integrated Circuits (ASIC s),Application-specific Standard Products (ASSPs), System-on-a-chip systems(SOCs), Complex Programmable Logic Devices (CPLDs), etc. Additionally,although functionality is described herein with regard to specificcomponents shown in example environment 100, it is contemplated that insome embodiments functionality of these components can be shared ordistributed across other components.

In some cases, environment 100 may comprise user device 120, which mayfurther comprise audio component 102, imagery component 104, locationcomponent 106, display component 108, and input component 110. Userdevice 120 may include various devices, such as smartphones, smartwatches, tablets, personal digital assistants, tablets, laptopcomputers, digital cameras and the like. In some cases, user device 120may include devices such as smart mailboxes, smart home appliances, suchas a smart refrigerator, or other smart systems that are capable ofproviding information to a user and collect information from a user. Insome embodiments user device 120 may comprise camera 112. Camera 112 maybe capable of taking individual images or video. In some cases, userdevice 120 may comprise GUI 114, which may also be capable of receivinginputs from a user. User device 120 may be similar to computingenvironment 200 of FIG. 2. In some cases, user device 120 may beconfigured to run apps, such as computer software application 180 orservices stored locally and/or on datastore 125. In some cases, userdevice 120 may communicate with other components of environment 100. Forexample, in one aspect, user device 120 may be a digital camera that maylocally stores images, which may be communicated to other computingdevices or components, such as computing system 130 or datastore 125.Other devices that allow a user to collect information and transmit theinformation to components of environment 100 may also be consideredwithin the scope of user device 120. In some instances, user device 120may be associated with a customer of a logistics carrier or a party thatis receiving a parcel by way of the carrier from the customer.

In some aspects, user device 120 may comprise audio component 102, whichmay be a component capable of emitting and receiving sound. For example,audio component 102 may comprise a microphone or a speaker. Audiocomponent 120 may be capable of receiving and emitting a sounddetectable by a human. Audio component 120 may further be capable ofreceiving and emitting sound not detectable by the human ear, but may bedetectable by another device or machine.

In some aspects, user device 120 may further comprise imagery component104. Imagery component 104 may be capable of receiving visual imagesexternal to user device 120. For example, imagery component 104 may becamera 112. In some cases, imagery component 104 may be capable ofreceiving and communicating information corresponding to images thatwould be visual to the human eye. In some cases, imagery component 104may be capable of receiving images from a range or ranges of theelectromagnetic spectrum beyond which a human eye is capable ofdetecting, such as infrared and ultraviolet light. In such cases,imagery component 104 may convert aspects of the captured images to ahuman-detectable form and, for example, communicate the converted imagesto other components of environment 100 or display them on GUI 114.

In some cases, user device 120 may comprise location component 106.Location component 106 may be capable of determining the location andorientation of user device 120. Location may be determined by, forexample, cell network triangulation, GPS, and the like. In someinstances, location component 106 may similarly determine the locationof objects detected by imagery component 104. Location component 106 maybe able to detect and transmit the location of user device 120 or of anobject viewed by imagery component 104, and transmit the location tocomponents of environment 100, such as through communications network115.

In some embodiments, user device 120 may comprise display component 108.Display component 108 may provide visual feedback to a user. In oneexample, the display component 108 may be GUI 114. Display component 108may receive information, for example, from other components withinenvironment 100 or user device 120, and visually represent theinformation to the user. In some cases, information displayed may behuman readable text or machine readable codes. In some cases, displaycomponent 108 may display individual images or video, for example,images or video that are captured by imagery component 104, includingreal-time display; that are received from computer readable storagemedia, such as a local store or datastore 125; or that are received fromcommunications network 115. In some cases, display component 108 mayreceive input from the user. For example, display component 108 may betouch sensitive and detect physical inputs, such as from a person's handor a stylus. In some cases, display component 108 may detect variousforms of physical touch, such as from different sources, or may detectlevels of touch, such as hard or soft.

In some cases, user device 120 may comprise an additional inputcomponent. Some non-exclusive examples of input component 110 may be afingerprint reader, buttons, joystick, smartpads, track-and-ball, andthe like. In some cases, information gathered by input component 110 maybe stored locally in association with user device 120, transmittedthrough communications network 115 to any component of environment 100,or stored on datastore 125.

Environment 100 may further comprise computing system 130, which in somecases may comprise registration component 132 and suitability determiner134. Computing system 130 may be similar to exemplary computingenvironment 200 of FIG. 2. In some embodiments, registration component132 and suitability determiner 134 may comprise computer-executablesoftware instructions that may be executed by a processor, which, forexample, may be associated with computing system 130 or associated withuser device 120.

In some instances, registration component 132 may comprise instructionsfor guiding a user through a registration process. As an example, theuser may be guided through the registration process on user device 120using an app associated with user device 120, such as mobile app 180 ondatastore 125. The registration process, in some cases, may be designedto collect front-end information to aid in delivery/pickup of a parcelto a delivery/pickup location using an unmanned vehicle, such as UAV150. Some exemplary methods for registering the user are furtherdiscussed below. At another high level, registration component mayfurther provide teaching information to the user. For instance, suchteaching information may include how to request a delivery/pickup byunmanned vehicles. In many cases, users may not be knowledgeable as tothe best way to interact with unmanned vehicles, and the registrationprocess may be designed to guide users through this process.

Further, in some embodiments, registration component 132 may storecomputer-executable instructions that present the user with, for examplevia a mobile app, a set of configurable options. The set of configurableoptions may be presented to the user through a registration processsoftware wizard. In this example, the user may be guided through aset-up procedure which may include providing all or a portion of the setof configurable options. In some embodiments, aspects of the wizard orthe set of options may be available at any time for the user through themobile app.

Suitability determiner 134, in some cases, may receive input informationfrom user device 120, which may include inputs from audio component 102,imagery component 104, location component 106, display component 108,and input component 110. As shown in example operating environment 100,user device 120 includes these components 102, 104, 106, 108, and 110.However, it is also contemplated that in some embodiments, thesecomponents may be distributed in other devices or components of exampleoperating environment 100. For example, imagery component 104 may bepart of imaging system 145, and audio component 102 may be part ofstationary personal assistant 135. Similarly, location component 106 maybe part of stationary personal assistant 135.

In some embodiments, suitability determiner 134 may process the receivedinformation to determine if criteria for registration have been met. Insome examples, registration component 132 may request the user provideimages of the property so that suitability determiner 134 may determinewhat types of unmanned vehicles are capable of delivery/pickup to thedelivery/pickup location or if the delivery/pickup location is suitablefor delivery/pickup by unmanned vehicles. In some cases, the user may beprompted to provide a potential release/retrieve zone. Inputs from userdevice 120 may provide suitability determiner 134 enough information topredetermine that a potential release/retrieve zone may be used forunmanned delivery/pickup. Some examples of determining release/retrievezones are provided in more detail below. In some cases, suitabilitydeterminer 132 may suggest potential release/retrieve zones. Forexample, suitability determiner 132 may also receive information fromcommunications network 115, such as through the Internet or previouslystored data in datastore 125. This data may include aerial imagery,topographical information, and general map data. From this information,the suitability determiner 134 may suggest areas at or near thedelivery/pickup location that are suitable for unmanned delivery/pickupof a parcel. A user may then be provided the suggested potentialrelease/retrieve locations and prompted to select from among them viathe app 180 on user device 120.

Environment 100 may sometimes include stationary personal assistant 135,which may be embodied as a home personal assistant, smart appliance,smart speaker, or the like. Some examples of stationary personalassistant 135 may include Google Home or Amazon Echo with Amazon Alexa.Stationary personal assistant 135 may more broadly comprise othercomputing devices that may access communications network 115. Forexample, other mobile computing devices, smart appliances (e.g.,computer-integrated refrigerators, smart thermostats, smart securitysystems, home automation systems, and the like), home entertainmentsystems, vehicles, wearable computing devices, smart doorbells, smartlighting, computerized sensors, or other computing devices that may becharacterized as part of the “Internet of Things” (IoT) that areaccessible to communications network 115. Using communications network115, these IoT devices may communicate with components of environment100 to send and receive information.

In some embodiments, app 180 may be used to obtain additionalinformation about the user, such as a customer, the user's activity, andthe user environment. For example, during registration or installationof app 180, the user may consent to providing access by app 180 to userinformation including information accessible via user device 120 oraccounts associated with the user device 120 or the user. In particular,app 180 may request user consent for accessing email accounts, usercalendar information, social media accounts, other accounts associatedwith apps or IoT devices (e.g., a user's Google account or Amazon Alexarelated information), user activity information on user device 120(e.g., other apps installed, browsing activity, location, or other useractivity and information detectable from user device 120), and in someinstances, may request account information, permission, and/oraccount-credentials information from the user for accessing theseaccounts or obtaining this information. In this way, app 180, computingsystem 130, or other aspects of the embodiments described herein learnabout the user and particular resources (e.g., IoT devices) available tothe user, which may be used for personalizing the delivery/pickupexperience for the user. For example, by receiving consent accountinformation associated with a user's Amazon Echo device, or other IoTdevice, embodiments described herein may be enabled to providenotifications (which may include real time or near real timenotifications) about delivery/pickup to the user via an IoT device. Forexample, a user's smart refrigerator might issue an alert stating, “Youhave a package arriving in 5 minutes” or “You have a package arriving in5 minutes, is the dog restrained?” Similarly, a user may be able torequest status or changes to delivery or pickup options via their IoTdevice. For example, a user might say to her Amazon Echo device, “Alexa,do I have any deliveries expected today?” Or “Alexa, please have all oftoday's deliveries released in my alternate delivery/pickup zone.” Or“Alexa, I have a package to send. Please schedule a pickup for todayusing my primary delivery/pickup zone.”

In another example, using a user's calendar information, which may beobtained via consent and account information received via app 180 onuser device 120, it may be determined whether a user is likely to be ata particular location when a delivery is expected. Thus, delivery can betailored to the user by altering the delivery time or location tocoincide with the user's schedule, as determined from the calendar.Further, in one embodiment, app 180 may monitor user activity includinglocation activity of user device 120 in order to determine user activitypattern information for the user. For example, it may be determined thata user is typically at a particular location (e.g., their place ofemployment) from 8 am to 5 pm on Monday-Friday, or that a user typicallyarrives home after 9 pm on Wednesdays. Using this information,delivery/pickup can be tailored to fit the user's activity pattern,thereby personalizing the experience for the user. For instance, apackage may be redirected to the user's work location if it is moreefficient to deliver during the daytime on a weekday. Or a package thatrequires the user's signature may be delivered on Thursday instead ofWednesday, since the user typically will not be home until late.

In some embodiments, a recommendation or suggestion may be provided tothe user, via app 180, to modify or personalize the delivery based onthe observed user patterns. For example, the user may receive a promptor stating: “We have a package that requires your signature, would youprefer it to be delivered to your work during the day? Yes or No.”Similarly, the user may receive an SMS text message requesting adelivery change based on information learned from the user pattern. Insome embodiments, the personalization or modification of delivery may bespecific to only that parcel or may apply to all or most parcels goingforward.

In some embodiments, app 180 may determine the presence of othercomputing devices having access to network 115, such as IoT devices. Forexample, a customer may consent to allowing app 180 to access featuresor components of the other computing devices. In this way, similar toembodiments described above, app 180 may be able to delivernotifications to the customer using stationary personal assistant 135 orother IoT devices. In another example, app 180 may receive adelivery/pickup status from any of the components in environment 100that provides information about the delivery/pickup of a parcel. Basedon the customer's consent and/or information devised via app 180 or userdevice 120, app 180 or computing system 130 may communicate this statusto stationary personal assistant 135 (or other IoT devices) viacommunications network 115. Stationary personal assistant 135 (or otherIoT devices) may then communicate the status to the customer.

In some cases, similar to as described above, a user or customer mayprovide information utilizing the IoT computing devices. For example,information provided by the customer may indicate delivery/pickuppreferences, such as the time and place for an unmanned system to make adelivery/pickup. As an example, using stationary personal assistant 135the customer may provide a request that a delivery be made to thecustomer's place of work rather than a previously scheduled deliverylocation, such as the customer's home, or the customer may request thedelivery at a certain time so that the customer is present when thedelivery is made. In some cases, the information provided by thecustomer may be communicated to components of environment 100. Based onthis information delivery or pickup of the parcel may be altered orconfirmed.

In some cases, app 180 may access other features or apps associated withthe customer, such as other feature or apps on user device 120. Somenon-exclusive examples of other features or apps may be a customer'scontacts list; an electronic calendar; a virtual assistant, such asApple's Ski or Amazon's Alexa; payment information, which may be usedfor processing delivery/pickup fees, such as a credit card, bankaccount, or virtual wallet, and the like. In some instances some, all,or none of the feature or apps may be accessed based on customerconsent. As an example, a delivery/pickup may be altered based oninformation received from these feature or apps. For example, anunmanned delivery may be scheduled to a customer's home. The deliverymay require a signature by the customer or the customer may haverequested that parcels not be left unattended at the customer's home.Having access to a customer's electronic calendar, it may be determinedthat the customer is at his or her office, and not at a home location.Based on this information, an unmanned system, such as UAV 150, maydeliver the parcel to the customer's office rather than the homelocation, deliver to a neighbor's home, or withhold delivery until thecustomer is home, without making an unnecessary trip to the user's homein order to determine the user is not home, which is what happenscurrently under conventional delivery technologies.

In some embodiments, environment 100 may include mobile computing device140, an example of which may be a hand-held device carried by a deliveryservice provider. Mobile computing device 140 may have the same orsimilar components as those associated with user device 120. Mobilecomputing device 140 may be capable of collecting information andcommunicating to other components of environment 100. In some cases,mobile computing device 140 may read machine readable images, such asbar codes. This may include many types of bar codes, includingone-dimensional and two-dimensional bar codes. In some cases, mobilecomputing device 140 may receive information from machine readable tags,such as radio-frequency identification (RFID) tags. For instance, aparcel may have a bar code or a machine readable tag attached to it. Thebar code or tag may have associated identification information that maybe interpreted by mobile computing device 140. Further information aboutthe parcel may be stored, for example, on datastore 125. Mobilecomputing device 140 may receive information about the parcel andcommunicate it to, for example, datastore 125, which may also storeother information associated with the parcel, such as logistics notesand the parcel's location. Mobile computing device 140 may furtherreceive information associated with the parcel from datastore 125, andin some cases, it may display or communicate this information using aGUI or audible communication. Thus, mobile computing device 140 may sendand receive logistics information about a parcel, such as when and wherethe parcel is picked up, where the parcel is located at a given timealong a logistics route, and when and where the parcel is delivered.Mobile computing device 140 may receive other information about aparcel, such as its weight, dimensions, special instructions, logisticsnotes, and shipping priority level. In some cases, mobile device 140 maybe associated with a carrier in the business of receiving and deliveringparcels from pickup locations to delivery locations.

In some embodiments, environment 100 includes an imaging system 145.Imaging system 145 may, for example, be capable of image-mapping ortaking images of its surroundings. In some cases, images taken byimaging system 145 may be two- or three-dimensional images. Imagingsystem 145 may utilize one or more types of imaging techniques,including images from basic camera systems to more sophisticated systemssuch as LIDAR, sonar, radar, and the like. Imaging system 145 may takeindividual still images or may take video imagery. Images and video maybe stored in, for example, datastore 125, or may be transmitted to othercomponents of environment 100 in real time. In some embodiments, imagingsystem 145 may be mounted directly onto UAV 150 or terrestrial vehicle160.

UAV 150 is one example of an unmanned vehicle that may be used withenvironment 100. In FIG. 1, UAV 150 is depicted as a four-rotor verticaltakeoff and landing drone. However, it is not limited to this type ofsystem. In some instances, UAV 150 may comprise other aerial vehicles,terrestrial vehicles, underwater or subterranean vehicles, for example.For embodiments where UAV 150 is an aerial vehicle with rotors, anynumber of rotors may be utilized. For example, UAV 150 may be ahelicopter having a single, main rotor blade. In some cases, UAV 150 mayhave two, three, four, or more rotors. In some embodiments, UAV 150 maybe a vertical takeoff and landing drone. In some embodiments, UAV 150may be a fixed wing aircraft, such as those that provide vertical liftusing an air foil. UAV 150 may be capable of carrying a payload, such asone or more parcels. In some cases, UAV 150 may be able to release andretrieve parcels without physical human assistance, such as loading andunloading of a parcel.

In some embodiments, UAV 150 may communicate with satellite 170.Satellite 170 may provide a means for UAV 150 to communicate with othercomponents of environment 100. It is also contemplated that UAV 150 maycommunicate through other communications means, such as cellular, radio,microwave, WiFi, or other wireless communications protocols. As shown inFIG. 1, UAV 150 is communicatively coupled to one or more components ofoperating environment 100 through communications network 115. In somecases, satellite 170 may provide location information to UAV 150. Othermechanisms for determining location and altitude may be employed by UAV150 in addition to or instead of satellite 170. Some other nonexclusiveexamples include using cellular signal triangulation, WiFi access-pointlocation information, image recognition (e.g., identifying landmarks,road signs, other markings, or the using image information), andbarometric pressure.

In particular, as noted above, UAV 150 may carry or comprise imagingsystem 145. In some cases, the location and direction of UAV 150 mayfurther be determined by comparing images from imaging system 145 withstored images, for example, on datastore 125. For example, imagesreceived from user device 120 may be stored on datastore 125 ortransmitted directly to UAV 150. In some cases, images received fromimaging system 145 may be compared in real time to stored images, suchas those taken from user device 120. UAV 150 may further determine itslocation by comparing these images, and may determine additionallocation information, such as the location of a release/retrieve zone.

In some cases, environment 100 may comprise terrestrial vehicle 160.Terrestrial vehicle 160 may be a manned or unmanned vehicle and maycoordinate with UAV 150 through communications network 115, satellite170, or both. In some embodiments UAV 150 may be removably docked toterrestrial vehicle 160. For example, to release/retrieve a parcelto/from a delivery/pickup location, the parcel may be transported over aportion of the route in terrestrial vehicle 160 and over another portionof the route by UAV 150.

It should be understood that environment 100 architecture described withreference to FIG. 1 is an exemplary architecture and other arrangementsare contemplated. Further, components of environment 100, for example,user device 120, mobile computing device 140, or server 130, may bedescribed as or comprise computing devices or systems. An exemplarycomputing device 200 that may be suitable for components of environment100 is described now with reference to FIG. 2.

Computing device 200 is one example of a suitable computing environment,and its description is not intended to suggest any limitation as to thescope of use or functionality of this technology. Nor should computingdevice 200 be interpreted as having any dependency or requirementrelating to any one or combination of components illustrated.

Some aspects may be described in the general context of computer code ormachine-useable instructions, including computer-executable instructionssuch as program modules, being executed by a computer or other machine,such as a personal data assistant or other handheld device. Generally,program modules including routines, programs, objects, components, datastructures, and the like, refer to code that may perform particulartasks or implement particular abstract data types. Components may bepracticed in a variety of system configurations, including hand-helddevices, consumer electronics, general-purpose computers, more specialtycomputing devices, and similar devices. The technology may also bepracticed in distributed computing environments where tasks areperformed by remote-processing devices that are linked through acommunications network, such as communications network 115 in FIG. 1.

With reference to FIG. 2, computing device 200 may include bus 210 thatdirectly or indirectly couples the following devices: memory 212, one ormore processors 214, one or more presentation components 216,input/output (I/O) ports 218, I/O components 220, an illustrative powersupply 222, and communications component 224. Bus 210 represents whatmay be one or more busses (such as an address bus, data bus, orcombination thereof). Although the various blocks of FIG. 2 are shownwith lines for the sake of clarity, in reality, delineating variouscomponents is not so clear, and metaphorically, the lines would moreaccurately be grey and fuzzy. For example, one may consider apresentation component such as a display device to be an I/O component.Also, processors may have memory. The inventors recognize that such isthe nature of the art, and reiterate that the illustration of FIG. 2 ismerely representative of one exemplary computing device that may be usedin connection with one or more embodiments of the present technology.Distinction is not made between such categories as “workstation,”“server,” “laptop,” “hand-held device,” and similar categories, as allare contemplated to be within the scope of FIG. 2 and may be referencedas “computing device.”

Computing device 200 typically includes a variety of computer-readablemedia. Computer-readable media may include any available media that canbe accessed by computing device 200, and include both volatile andnonvolatile media, as well as removable and non-removable media. By wayof example, and not limitation, computer-readable media may comprisecomputer storage media and communication media. Computer storage mediaincludes both volatile and nonvolatile, removable and non-removablemedia implemented in any method or technology for storage of informationsuch as computer-readable instructions, data structures, programmodules, or other data. Examples of computer storage media include, butare not limited to, RAM, ROM, EEPROM, flash memory or other memorytechnology, CD-ROM, digital versatile disks (DVD) or other optical diskstorage, magnetic cassettes, magnetic tape, magnetic disk storage orother magnetic storage devices, or any other medium which can be used tostore the desired information and which can be accessed by computingdevice 200. Computer storage media does not comprise signals per se.

Communication media typically embodies computer-readable instructions,data structures, program modules, or other data in a modulated datasignal such as a carrier wave or other transport mechanism and includesany information delivery media. The term “modulated data signal” means asignal that has one or more of its characteristics set or changed insuch a manner as to encode information in the signal. By way of example,and not limitation, communication media includes wired media such as awired network or direct-wired connection, and wireless media such asacoustic, RF, infrared, and other wireless media. Combinations of any ofthe above should also be included within the scope of computer-readablemedia.

Memory 212 includes computer-storage media in the form of volatileand/or nonvolatile memory. The memory may be removable, non-removable,or a combination thereof. Exemplary hardware devices include solid-statememory, hard drives, optical-disc drives, and the like. Computing device200 includes one or more processors that read data from various entitiessuch as memory 212 or I/O components 220. Presentation component(s) 216present data indications to a user or other device. Exemplarypresentation components include a display device, speaker, printingcomponent, vibrating component, and other communicative components.

I/O ports 218 allow computing device 200 to be logically coupled toother devices including I/O components 220, some of which may be builtin. Illustrative components include a microphone, joystick, game pad,satellite dish, scanner, printer, wireless device, and the like. The I/Ocomponents 220 may provide a natural user interface (NUI) that processesair gestures, voice, or other physiological inputs generated by a user.In some instances, inputs may be transmitted to an appropriate networkelement for further processing. An NUI may implement any combination ofspeech recognition, touch and stylus recognition, facial recognition,biometric recognition, gesture recognition both on screen and adjacentto the screen, air gestures, head and eye tracking, and touchrecognition associated with displays on the computing device 200. Insome cases, computing device 200 may be communicatively coupled to otherdevices or components through communications network 224, such as LANs,WANs, cellular networks, the Internet, and the like. Communicationsnetwork 224 may be similar to communications network 115 in FIG. 1.

The computing device 200 may be equipped with depth cameras, such asstereoscopic camera systems, infrared camera systems, RGB camerasystems, and combinations of these for gesture detection andrecognition. Additionally, the computing device 200 may be equipped withaccelerometers; gyroscopes; magnetometers; and sensing devices, such assonar, radar, and LIDAR that enable detection of motion. The output ofthe accelerometers or gyroscopes may be provided to the display of thecomputing device 200 to render immersive augmented reality or virtualreality.

Systems and components described may be used to collect front-endinformation from a customer. The front-end information may be associatedwith a delivery/pickup location, and may help register thedelivery/pickup location for unmanned delivery/pickup. In some cases,registering a location for delivery/pickup by unmanned vehicles maycomprise a determination that the location is suitable fordelivery/pickup by an unmanned vehicle of some type. Put another way,registration of a location occurs prior to an initial delivery of aparcel by an unmanned vehicle. The registration may, for example, bebased on user inputs, including consents, or may be based on otherinformation received, such as sensed data through components ofenvironment 100, or information received from other sources, such asthrough the Internet. Thus, having determined on the front end that alocation is capable of delivery/pickup by an unmanned vehicle,determinations as to the most optimum or efficient delivery/pickupmethod may be made, including a decision to deliver/retrieve a parcelusing an unmanned vehicle. In some cases, this front-end information maybe used to establish a release/retrieve zone at a delivery/pickuplocation as part of the registration processes.

FIGS. 3A-3C illustrate one exemplary method of collecting front-endinformation by receiving customer 305 inputs on a GUI displaying a mapor image of the delivery/pickup location. This information may aidunmanned vehicles in delivering a parcel to the delivery/pickuplocation. In FIG. 3A, GUI 314 may display a map of the delivery/pickuplocation. In some cases, the current location of customer 305 may beused to determine the delivery/pickup location. In some cases, customer305 may provide the desired delivery/pickup location. Maps of thedelivery/pickup location may be derived from numerous sources. Someexamples include sensed data received from sensing devices, such asimaging system 145; images taken from other components of environment100, such as satellite 170; and maps derived from the Internet, forexample communications network 115 of FIG. 1. Turning back to FIGS.3A-3C, an exemplary map of a delivery/pickup location having yard 321,home 322, driveway 323, main road 324, and garage 326 is illustrated.

GUI 314 may receive input from customer 305 that may aid indelivery/pickup of a parcel by unmanned vehicles. In some embodiments,customer 305 may provide input by touching or drawing on GUI 314. Insome cases, customer 305 may draw off-limits area 310 on the map. Anexample of this is illustrated in FIG. 3A. Off-limits area 310 may be alocation or area where customer 305 does not want an unmanned vehicle totraverse. In some cases, in the configurable options, customer 305 mayfurther define off-limits area 310 to apply only to certain types ofunmanned vehicles. For example, customer 305 may not have an issue withunmanned terrestrial vehicles; however, customer 305 may prefer not toallow UAVs within off-limits area 310. When off-limits area 310 isdesignated as an area that only prohibits UAVs, off-limits area 310 maybe considered a no-fly zone. Off-limits area 310 may be defined bycustomer 305, by municipalities, by states, by the federal government,or by other entities having authority over areas of land. Off-limitsarea 310 may be permanent; for example, off-limits area 310 may remainoff limits to unmanned vehicles until customer 305 changes the status ofthe area or, in some cases, off-limits area 310 may be temporary. Forexample, using the configurable options, customer 305 may set abeginning and end time for off-limits area 310 or off-limits area 310may expire after a predefined time. For example, in some cases,governments or private entities may temporarily define off-limits area310, such as to accommodate a sporting event or a parade. Off-limitsarea 310 may be general, excluding multiple types of unmanned vehicles,or may be defined more narrowly, such as a no-fly zone for UAVs.

FIG. 3B depicts customer 305 setting release/retrieve zone 330 fordelivery/pickup of a parcel by an unmanned vehicle. Release/retrievezone 330 has been represented by a circle and crosshairs. However, it isnot restricted to this exemplary depiction and may take any form orshape. In some cases, customer 305 may request a potentialrelease/retrieve zone on the map using GUI 314. It may be determined ifthe potential release/retrieve zone is suitable for delivery/pickup byan unmanned vehicle. The suitability of the potential release/retrievezone may be determined based on the configurable settings. For example,if customer 305 has restricted delivery/pickup to only terrestrialvehicles, potential release/retrieve zones that are accessible only byusing a UAV may not be suitable because of the restriction configured bycustomer 305. In some cases, customer 305 may be provided feedback whenthe potential area is suitable. For instance, GUI 314 may display adifferent icon, a different colored icon, a visual change to an icon, orsome other form of visual notification that indicates suitability. Othernotifications, such as a vibration, which may come from a mobile deviceassociated with GUI 314, may occur as well. In some embodiments, whenthe customer suggests a potential release/retrieve zone, and therelease/retrieve zone is determined to be suitable based on thesettings, then the release/retrieve zone may be established, such asrelease/retrieve zone 330. For example, establishing a release/retrievezone may comprise associating release/retrieve zone 330 with thedelivery/pickup location such that, when delivery/pickup of a parcel ismade utilizing an unmanned vehicle, the unmanned vehicle haspredetermined information on where to release/retrieve the parcel at thedelivery/pickup location. In some cases, establishing a release/retrievezone provides front-end information that allows an unmanned vehicle todeliver a parcel without the unmanned vehicle having to determine asuitable release/retrieve zone when at a delivery/pickup location. Assuch, an unmanned vehicle may have to make fewer decisions during thedelivery/pickup process. As more information is collected on the frontend, route planning becomes more efficient, which improves the overalldelivery/pickup and logistics process.

FIG. 3C illustrates customer 305 setting more than one release/retrievezone. For example, customer 305 may desire to define alternaterelease/retrieve zone 335 if, for instance, delivery/pickup torelease/retrieve zone 330 is impracticable, impossible, or unsafe.Scenarios such as these may occur during delivery/pickup if, forexample, a car is parked in driveway 323 or children are playing indriveway 323. As such, alternate delivery/pickup zone 335 may serve as abackup release/retrieve area. In many cases, determining contingencieson the front end promotes more efficient logistics because the chancesof a successful delivery/pickup are much higher.

In some cases, when deciding where to locate off-limits area 310,release/retrieve zone 330, and alternate release/retrieve zone 335, themap may show customer 305 locations where off-limits areas andrelease/retrieve zones may or may not be located. In some cases, areasthat are suitable for delivery/pickup by unmanned vehicles may bedetermined and suggested to customer 305, for example, by superimposingsuggested areas on the map (not shown). This may give customer 305selectable options when determining placement of an off-limits area orrelease/retrieve zone. For example, it may be determined that arelease/retrieve zone for a terrestrial vehicle is available becausethere is easy access to the property using driveway 323 off main road324. However, the same area may not be suitable for delivery/pickup byUAV due to the presence or density of trees in the area. Thus, thesystem may suggest a release/retrieve zone along the driveway. Inanother example, customer 305 may have a gravel driveway with steepgrade such that delivery/pickup by a terrestrial vehicle isimpracticable. However, customer 305 may have a large area of flat landeasily accessible to a UAV. In this case, the system may recommend arelease/retrieve zone on the flat area of land having a large enoughradius for delivery/pickup by UAV. In some cases, if the area of therelease/retrieve zone is only large enough for certain types of UAVs,then the system may store this information so that when logisticsdecisions are being made, only those UAVs that are able todeliver/pickup from the delivery/pickup location are dispatched.

In some embodiments, a registration wizard may be used to guide a userstep-by-step through the process of registering a delivery/pickuplocation for unmanned delivery/pickup. FIG. 4 illustrates an exemplaryprocess by which a customer may register a delivery/pickup location fordelivery/pickup by unmanned vehicles, including setting off-limits areasand release/retrieve zones using a similar method as described withregard to FIGS. 3A-3C. However, it should be noted that guiding acustomer through a registration process using a wizard may be utilizedby any of the embodiments described herein.

Exemplary registration process 400 in FIG. 4 asks a customer to registerfor unmanned delivery/pickup at step 405. If yes, process 400 mayproceed to step 410. At step 410 it may be determined if the customerconsents to delivery/pickup by a UAV. If yes, the process may proceed tostep 420. At step 420, the customer may be asked if they would like tocreate an off-limits area. If so, the process may proceed to step 425,where the customer may be prompted to set an off-limits area. Aftersetting the off-limits area, or perhaps skipping this step, the customermay be instructed to set a release/retrieve zone in step 430. At step435, the customer may suggest or be provided a release/retrieve zone.After setting the release/retrieve zone in step 435, the customer, insome cases, may be prompted to take additional photographs of therelease/retrieve zone area at step 440. For example, the customer may beasked to take images of the area above and around the release/retrievezone. This front-end information may help determine the best route tothe release/retrieve zone and the types of unmanned vehicles that mayaccess the release/retrieve zone, or in some cases, it may helpdetermine if there are obstacles that render the area unsuitable forbeing a release/retrieve zone. At step 445, the customer may take imagesof the release/retrieve zone. At step 450, the customer may be providedfeedback that the registration process is complete.

In some cases, registration of a delivery/pickup location may becompleted by determining that the location is suitable for unmanneddelivery/pickup. For example, location information may be provided suchthat it may be determined that one or more types of unmanned vehiclesare capable of making deliveries to a delivery/pickup location. Forexample, information may be collected from images taken of thedelivery/pickup location; by inputs, such as consents, from a customerassociated with the delivery/pickup location; from information receivedvia components associated with a communications network, such as thatdescribed with respect to FIG. 1; from information provided via theInternet; or the like. By determining that the delivery/pickup locationis suitable for unmanned delivery/pickup and registering the locationfor delivery/pickup by unmanned vehicles, logistics decision-making maybe improved because the number of delivery/pickup options available to acarrier making the deliveries is increased.

Turning now to FIG. 5, FIG. 5 illustrates an exemplary method forestablishing a release/retrieve zone at a delivery/pickup location. InFIG. 5, customer 505 is using augmented reality provided by user device520 to establish a release/retrieve zone and provide front-endinformation to the system. FIG. 5 shows customer 505 standing in yard521 having driveway 523. Further, yard 521 may have obstacles 510.Obstacle 510 may be anything that prevents, impedes, or alters a coursefor delivery/pickup of a parcel to a release/retrieve zone.

FIGS. 6A-6D show GUI 614 associated with user device 520 in FIG. 5. Aspreviously described, user device 520 may comprise a camera that mayreceive images from its surroundings and display the images in real timeusing GUI 614. Thus, for example, as the orientation of user device 520changes, GUI 614 will change the displayed images in accordance with theorientation of user device 520. FIGS. 6A-6D represent one example ofusing augmented reality to establish a release/retrieve zone. In thisexample, GUI 614 may display potential release/retrieve zone 600. Forexample, potential release/retrieve zone 600 may be superimposed onbackground 625. In some cases, potential release/retrieve zone 600 maybe stationary. In some cases, potential release/retrieve zone 600 maymove about GUI 614 as the orientation of user device 520 of FIG. 5changes. For example, in order to maintain scale, potentialrelease/retrieve zone 600 may change in size or orientation as the rangeof objects viewed in background 625 changes. For example, whenbackground 625 comprises yard 521 and yard 521 is in a horizontal planerelative to the GUI, release/retrieve zone 600 may appear to have anoval shape along the horizontal plane. In some embodiments, potentialrelease/retrieve zone 600 may appear to increase in size as the range ofbackground 625 becomes a shorter distance. Likewise, as the range ofbackground 625 increases, potential release/retrieve zone 600 may appearto decrease in size. Obstacles 610 to setting a release/retrieve zonemay also be viewed in background 625.

In some cases, it may be determined in real time whether thesuperimposed potential release/retrieve zone is positioned orsuperimposed over an area in background 625 that may be suitable forsetting a release/retrieve zone for unmanned delivery/pickup. Like otherembodiments, this determination may be made based on configurablesettings, for example, a customer's consent settings as to the types ofunmanned vehicles that may be permitted to deliver to a particular area.In some cases, if a determination is made that potentialrelease/retrieve zone 600 is suitable for delivery/pickup, indication602 may be provided. In some instances, indication 602 may appear as avisual change, such as changing the color, shape, or visual intensity ofthe display, on GUI 614, and in some instances, it may be provided astactile feedback, for example vibration.

In some embodiments, the system may automatically establish potentialrelease/retrieve zone 600 as the release/retrieve zone for unmanneddelivery/pickup based on the location being suitable. In some cases,once indication 602 is provided, the system may communicate a request tothe customer to confirm the release/retrieve zone.

In some cases, a customer may be prompted to place a user device as nearas possible to the release/retrieve zone so that the system maydetermine additional location information using location components ofthe user device. In some cases, a customer may be prompted to takeimages of the area. This may include the area in which a potentialrelease/retrieve zone is located or in which a release/retrieve zone hasbeen established. This front-end information may help determine whethera release/retrieve zone may be utilized by certain unmanned vehicles.Similarly, once established, customers may be asked to take additionalimagery of the release/retrieve zone from time to time. In one example,a customer may be asked to place a user device at the release/retrievezone with a camera facing upward. Imagery may be taken from this angleto determine if descent by a UAV is possible. In some cases, if therelease/retrieve zone is determined to be unsuitable based on theimagery provided, the system may ask the customer to establish anotherrelease/retrieve zone.

FIGS. 7A-7C have been provided to illustrate some exemplary effects oflocations that include off-limits areas 710. For example, UAV 750 mayproceed along path 740 to deliver a parcel to delivery/pickup location732. Path 740 may be determined so as to avoid off-limits areas 710 anddeliver the parcel to release/retrieve zone 730 at delivery/pickuplocation 732. In some cases, a customer associated with delivery/pickuplocation 732 may view the progress of UAV 750 along path 740 through GUI714. In some cases, off-limits areas 710 and release/retrieve zones notassociated with delivery/pickup location 732 may not be displayed to thecustomer. One such example is provided in FIG. 7B.

Turning to FIG. 7C, in some cases, unmanned vehicles may be required toavoid off-limits areas 710, such as no-fly zones, that are set byentities other than a customer. For example path 740 for UAV 750 may bedetermined so as to avoid larger off-limits areas 710 set by agovernment entity. Off-limits areas 710 may be permanent, such as thoseassociated with an airport, or may be temporary, such as thoseassociated with a sporting event.

FIG. 8 is a block diagram that represents exemplary method 800 forestablishing a delivery/pickup location. In step 810, a set ofconfigurable options is presented to a user. The configurable optionsmay be options for delivery/pickup of a parcel using unmanned vehicles.In some cases, the options may comprise a request for a release/retrievezone. In step 820, one or more inputs are received based on the set ofconfigurable options, and in some cases, at least one input comprises apotential release/retrieve zone. In step 830, it is determined whetherthe potential release/retrieve zone is a suitable release/retrieve zoneto be the release/retrieve zone for a delivery/pickup of a parcel by anunmanned vehicle. In some cases, the determination may be made based onthe received inputs to the set of configurable options. In step 840, ifthe potential release/retrieve zone is determined to be suitable, thepotential release/retrieve zone is established as the release/retrievezone for delivering the parcel to the delivery/pickup location using anunmanned vehicle.

FIG. 9 is a block diagram of exemplary method 900 for establishing arelease/retrieve zone for delivery/pickup of a parcel by an unmannedvehicle. At step 910, a request to establish a release/retrieve zone forthe unmanned vehicle to deliver the parcel to a delivery/pickup locationis presented to a user via a GUI. At step 920, location informationassociated with the delivery/pickup location is received. For example,in some cases, the information received may be images of thedelivery/pickup location, coordinates for the delivery/pickup location,an address associated with a delivery/pickup location, a user's currentlocation, an input to establish and off-limits area, potentialrelease/retrieve zones, and the like. At step 930, based on the receivedlocation information, one or more potential release/retrieve zones areprovided. At step 940, a selection of the one or more potentialrelease/retrieve zones is received. At step 950, the release/retrievezone for delivery/pickup of the parcel by the unmanned vehicle isestablished based on the selection.

FIG. 10 is a block diagram of exemplary method 1000 for registering adelivery/pickup location for unmanned delivery/pickup of a parcel. Atstep 1010, a request to register the delivery/pickup location forunmanned delivery/pickup is received. For example, the request may bereceived from a user utilizing a user device. At step 1020, locationinformation associated with the delivery/pickup location is received. Atstep 1030, the availability of unmanned delivery/pickup is determinedbased on information received. At step 1040, based on the availabilityof unmanned delivery/pickup, the delivery/pickup location is registeredfor delivery/pickup of a parcel by the unmanned vehicle.

From the foregoing, it will be seen that this technology is one welladapted to attain all the ends and objects described above, includingother advantages which are obvious or inherent to the structure. It willbe understood that certain features and subcombinations are of utilityand may be employed without reference to other features andsubcombinations. This is contemplated by and is within the scope of theclaims. Since many possible embodiments of the described technology maybe made without departing from the scope, it is to be understood thatall matter described herein or illustrated in the accompanying drawingsis to be interpreted as illustrative and not in a limiting sense.

For example, further embodiments may be described as one or morecomputer-readable media having computer-executable instructions embodiedthereon that, when executed by a computing device, causes the computingdevice to present a graphical user interface (GUI) that displaysunmanned vehicle delivery/pickup scenarios, the GUI comprising: a map;an unmanned vehicle; and a delivery/pickup location. In one embodiment,the map is an aerial image of an area. In one embodiment, the map is adepiction of an area, wherein the depiction comprises representations oftransportation structures. In one embodiment, the transportationstructures may be roads. In one embodiment, the unmanned vehicle is aterrestrial vehicle. In one embodiment, the unmanned vehicle is anunmanned aerial vehicle. In one embodiment, the unmanned aerial vehicleis a vertical takeoff and landing drone. In one embodiment the GUIfurther comprises a parcel. In one embodiment, the parcel is situated onthe unmanned vehicle. In one embodiment, the GUI further comprises apath. In one embodiment, the path may extend from the unmanned vehicleto the delivery/pickup location. In one embodiment, the GUI furthercomprises a release/retrieve zone. In one embodiment the pickup/retrievezone is associated with the delivery/pickup location. In one embodiment,the path may extend from the unmanned vehicle to the release/retrievezone. In one embodiment, the GUI further comprises an off-limits area.In one embodiment, the off-limits area is a no-fly zone.

Another embodiment comprises one or more non-transitorycomputer-readable media having computer-executable instructions embodiedthereon that, when executed by a computing device, causes the computingdevice to present a graphical user interface (GUI) that displays anaugmented reality background to assist in unmanned delivery/pickup, theGUI comprising: the augmented reality background and a potentialrelease/retrieve zone. In one embodiment, the potential release/retrievezone is a circle. In one embodiment, the circle comprises crosshairs. Inone embodiment the potential release/retrieve zone comprises an oval onsuperimposed on a horizontal plane. In one embodiment, the potentialrelease/retrieve zone dynamically changes orientation relative to theaugmented reality background. In one embodiment, the GUI furthercomprises an indication, wherein the indication is based on suitabilityof the potential release/retrieve zone to receive a parcel fordelivery/pickup by an unmanned vehicle. In one embodiment, theindication may be one of a change in color, shape, or visual intensityof the potential release/retrieve zone.

Another embodiment comprises a method for utilizing internet connecteddevices to make delivery/pickup decisions, the method comprising:receiving user activity information via one or more internet connecteddevices; predicting, based on the received user activity information, apredicted user location at time (t); determining that a scheduleddelivery/pickup location and delivery/pickup time do not match thepredicted user location at time (t); based on determining that thescheduled delivery/pickup location and delivery/pickup time do not matchthe predicted user location at time (t), routing a delivery system todeliver/retrieve a parcel associated with the user to/from the predicteduser location at time (t). In one embodiment, the method furthercomprises: presenting the user one or more delivery options utilizingthe one or more internet connected devices; receiving from the user oneor more instructions for delivering/retrieving the parcel associatedwith the user. In one embodiment, the one or more instructions fordelivering/retrieving the parcel change the scheduled delivery/pickuplocation and delivery/pickup time. In one embodiment, the method furthercomprises providing a confirmation of the change to the user. In oneembodiment, information is received based on the user's consents. In oneembodiment, the method further comprises requesting permission to accessaccount information. In one embodiment, the internet connected device isa stationary personal assistant. In one embodiment, the user accountinformation is received from one of an email account, a calendar, and asocial media account associated with the user. In one embodiment, themethod further comprises sending a notification to the user indicatingthe predicted user location at time (t) or the scheduled delivery/pickuplocation and delivery/pickup time. In one embodiment, the notificationis provided using the internet connected device. In one embodiment, thenotification is provided via an SMS text message. In one embodiment, themethod further comprises determining a user activity pattern, whereinthe user activity pattern is utilized to predict the predicted userlocation at time (t). In one embodiment, pickup/delivery of a parcel isredirected to the predicted user location at time (t) becausepickup/delivery requires a signature of the user. In one embodiment, thedelivery system is an unmanned vehicle. In one embodiment, the unmannedvehicle is an unmanned aerial vehicle. In one embodiment, the unmannedaerial vehicle is a vertical takeoff and landing drone. In oneembodiment the delivery system is a manned vehicle.

What is claimed is:
 1. A system for facilitating delivery/pickup by anunmanned vehicle, the system comprising: one or more processors; andcomputer storage media having computer-readable instructions storedthereon that when executed by the one or more processors, cause the oneor more processors to: prior to receiving a delivery request, receiveimagery of an area associated with the current location of a usercomputing device from the user computing device; present at a display ofthe user computing device, a graphical user interface comprising theimagery; determine at least one potential release/retrieve zone for thearea displayed within the imagery, based on a capability of the unmannedvehicle to deliver/pickup a parcel at the at least one potentialrelease/retrieve zone; based on information within the imagery,determine that either a terrestrial unmanned vehicle, an aerial unmannedvehicle, or both the terrestrial unmanned vehicle and the aerialunmanned vehicle are capable of delivering to the at least one potentialrelease/retrieve zone; for each of the at least one potentialrelease/retrieve zones, generate at least one augmented reality iconsuperimposed on the imagery, each of the at least one augmented realityicons indicating at least one of the at least one potentialrelease/retrieve zones, wherein a first color of the at least oneaugmented reality icon indicates that the at least one potentialrelease/retrieve zone is only available for the terrestrial unmannedvehicle, a second color of the at least one augmented reality iconindicates that the at least one potential release/retrieve zone is onlyavailable for the aerial unmanned vehicle, and a third color of the atleast one augmented reality icon indicates that the at least onepotential release/retrieve zone is available to both the aerial unmannedvehicle and the terrestrial unmanned vehicle; receive, from the usercomputing device displaying the graphical user interface, a selection ofat least one of the augmented reality icons by the user; and establish apath to the selected potential release/retrieve zone for thedelivery/pickup by the unmanned vehicle based on receiving the selectionof the at least one augmented reality icon by the user.
 2. The system ofclaim 1, further comprising registering the selected potentialrelease/retrieve zone for future delivery/pickup.
 3. The system of claim1, further comprising, receiving an input from a user at the graphicaluser interface, the input defining boundaries of an area within theimagery as a new off-limits area for an unmanned vehicle, wherein theimagery is captured by a camera of the user computing device.
 4. Thesystem of claim 1, wherein the selection of the at least one augmentedreality icon indicates a preference for the aerial unmanned vehicle. 5.The system of claim 1, further comprising providing, for presentation atthe user computing device, a map comprising the potentialrelease/retrieve zones superimposed onto the map.
 6. The system of claim3, further comprising displaying the new off-limits area within theimagery.
 7. The system of claim 6, wherein the new off-limits area isdisplayed as an augmented reality icon within the imagery.
 8. The systemof claim 1, further comprising receiving, from the computing devicedisplaying the graphical user interface, a second input comprising asecond potential release/retrieve zone selected from the determined atleast one potential release/retrieve zone, wherein the second selectedpotential release/retrieve zone comprises an alternate potentialrelease/retrieve zone for the delivery/pickup by the unmanned vehicle.9. A method of delivery/pickup by an unmanned vehicle, the methodcomprising: prior to receiving a delivery request, receiving imageryfrom a camera of a user computing device of an area associated with thecurrent location of the user computing device; presenting at a displayof the user computing device, a graphical user interface comprising theimagery; determining at least one potential release/retrieve zone forthe area displayed within the imagery, based on a capability of theunmanned vehicle to deliver/pickup a parcel at the at least onepotential release/retrieve zone; based on information within theimagery, determining that either a terrestrial unmanned vehicle, anaerial unmanned vehicle, or both the terrestrial unmanned vehicle andthe aerial unmanned vehicle are capable of delivering to the at leastone potential release/retrieve zone; for each of the at least onepotential release/retrieve zones, generating at least one augmentedreality icon superimposed on the imagery, each of the at least oneaugmented reality icons indicating at least one of the at least onepotential release/retrieve zones, wherein a first color of the at leastone augmented reality icon indicates that the at least one potentialrelease/retrieve zone is only available for the terrestrial unmannedvehicle, a second color of the at least one augmented reality iconindicates that the at least one potential release/retrieve zone is onlyavailable for the aerial unmanned vehicle, and a third color of the atleast one augmented reality icon indicates that the at least onepotential release/retrieve zone is available to both the aerial unmannedvehicle and the terrestrial unmanned vehicle; receiving, from the usercomputing device, a selection of at least one of the augmented realityicons by the user; providing the at least one release/retrieve zoneindicated by the at least one augmented reality icon selected potentialrelease/retrieve zone to the unmanned vehicle; and navigating theunmanned vehicle along a path to the selected potential release/retrievezone to deliver/pickup the parcel.
 10. The method of claim 9, whereinthe selection is part of a registration process for establishingdelivery/pickup by unmanned vehicles.
 11. The method of claim 9, furthercomprising registering the selected potential release/retrieve zone forfuture delivery/pickup.
 12. The method of claim 9, further comprisingproviding, for presentation at the user computing device, a mapcomprising the potential release/retrieve zones superimposed onto themap, wherein the selected potential release/retrieve zone is selectedfrom the potential release/retrieve zones presented on the map.
 13. Themethod of claim 9, wherein the selection of the at least one augmentedreality icon indicates a preference for the aerial unmanned vehicle. 14.Computer storage media having stored thereon computer-readableinstructions that when executed by one or more processors, cause the oneor more processors to perform a method facilitating unmanneddelivery/pickup of a parcel, the method comprising: prior to receiving adelivery request, receiving imagery from a camera of a user computingdevice of an area associated with the current location of the usercomputing device; presenting at a display of a user computing device, agraphical user interface comprising the imagery; determining at leastone potential release/retrieve zone for the area displayed within theimagery, based on information within the imagery, and a capability ofthe unmanned vehicle to deliver/pickup a parcel at the at least onepotential release/retrieve zone; based on information within theimagery, determining that either a terrestrial unmanned vehicle, anaerial unmanned vehicle, or both the terrestrial unmanned vehicle andthe aerial unmanned vehicle are capable of delivering to the at leastone potential release/retrieve zone; for each of the at least onepotential release/retrieve zones, generating at least one augmentedreality icon superimposed on the imagery, each of the at least oneaugmented reality icons indicating at least one of the at least onepotential release/retrieve zones, wherein a first color of the at leastone augmented reality icon indicates that the at least one potentialrelease/retrieve zone is only available for the terrestrial unmannedvehicle, a second color of the at least one augmented reality iconindicates that the at least one potential release/retrieve zone is onlyavailable for the aerial unmanned vehicle, and a third color of the atleast one augmented reality icon indicates that the at least onepotential release/retrieve zone is available to both the aerial unmannedvehicle and the terrestrial unmanned vehicle; receiving, from acomputing device, a selection of at least one augmented reality icon bya user; providing the at least one release/retrieve zone indicated bythe selected at least one augmented reality icon to the unmannedvehicle.
 15. The media of claim 14, wherein the potentialrelease/retrieve zones presented at the display are determined based ona configurable option indicating a type of unmanned vehicle.
 16. Themedia of claim 14, wherein the graphical user interface furthercomprises a map of the area, the potential release/retrieve zones beingsuperimposed onto the map.
 17. The media of claim 14, further comprisingdisplaying an off-limits area within the imagery.
 18. The media of claim17, wherein the off-limits area is displayed as an augmented realityicon within the imagery.
 19. The media of claim 14, wherein theselection of the at least one augmented reality icon indicates apreference for the terrestrial unmanned vehicle.
 20. The media of claim17, further comprising: receiving an input from the user indicating abeginning time in which the off-limits area is active, and an endingtime in which the off-limits area is inactive.